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Abstract. For families of random walks {Sj^ } with ESj^ = —ka < we 
consider their maxima M^"' = supj.>Q S^"'. We investigate the asymptotic 
behaviour of M^""^ as a — > for asymptotically stable random walks. This 
problem appeared first in the 1960's in the analysis of a single-server queue 
when the traffic load tends to 1 and since then is referred to as the heavy-traffic 
approximation problem. Kingman and Prokhorov suggested two different ap- 
proaches which were later followed by many authors. We give two elementary 
proofs of our main result, using each of these approaches. It turns out that 
the main technical difficulties in both proofs are rather similar and may be 
resolved via a generalisation of the Kolmogorov inequality to the case of an 
infinite variance. Such a generalisation is also obtained in this note. 



Assume that {Xi}""^^ is a sequence of i.i.d. random variables with a zero expec- 
tation: EX I ~ 0. Define a random walk 

fc 

5o = 0, S-fc^^X, for k>l. 

i=l 

Along with the random walk {Sk}, for each a > define a random walk {>S'^"''} via 

5^°' = Sk - ka. 

Now we can define 

k>0 

Since the random walk S'^,"^ drifts to — cxd, the maximum is a proper random 

variable for each a > 0. However, A/^"^ +oo in probability as a ^ 0. From this 
fact a natural question arises: How fast does A-/'") grow as a ^ 0? 

It is well-known that the stationary distribution of the waiting time of a customer 
in a single-server first-come-first-served (GI/GI/l) queue coincides with that of 
the maximum of a corresponding random walk. The condition on the mean of the 
random walk becoming small (a —>■ 0) means in the context of a queue that the 
traffic load tends to 1. Thus, the problem under consideration may be seen as 
the investigation of the growth rate of the stationary waiting-time distribution in 
a GI/GI/1 queue. This is one of the most important problems in the queueing 
theory that is referred to as the heavy-traffic analysis. The question was first posed 
by Kingman [5l |6] (see also [7] for an extensive discussion) who considered the case 
when \Xi\ has an exponential moment and proved that 
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for all a; > as a —> 0, where — VarXi. In his proof, Kingman used an 
analytical approach. Namely, he applied an expression for the Laplace transform 
of M(°) which follows from the Wiener- Hopf factorisation. 

Prokhorov generalised the latter result to the case when VarXi G (0, cx)). 
Prokhorov's approach was based on the functional Central Limit Theorem. 

These two approaches have become classical and have both been used to prove 
various heavy-traffic results. However, they seem to have never been compared. 
Later in this note we shall discuss both approaches in more detail and point out their 
differences and similarities. The analytical approach was used by Boxma and Cohen 
[2] (see also Cohen |3]) to study the limiting behaviour of A/'^"-' in the case of an 
infinite variance. They proved that if P(Xi > x) is regularly varying at infinity with 
a parameter 1 < a < 2 (and under some additional assumptions), then there exists 
a function A(a) such that A(a)M'-"' converges in law to a proper random variable. 
Furrer and Resnick and Samorodnitsky [lOj proved similar results assuming that 
the random walk {Sn} belongs to the domain of attraction of a spectrally positive 
stable law and using functional limit theorems. It is worth mentioning that Furrer 
has computed the corresponding limit distribution explicitly. 

The main purpose of the present note is to determine the asymptotic behaviour 
of M(°) for any random walk from the domain of attraction of a stable law. 

A random walk {Sn} is said to belong to the domain of attraction of a stable 
law with index a G (0, 2], if there exist sequences 5„ and c„ such that 

Sn bn ^ , , 

> ^ weakly, 

where ^ has the corresponding stable distribution. 

It is known that the random walk {Sn} belongs to the domain of attraction of a 
stable law with index a £ (0, 2] iff the function 

V{x) := E{X^, \Xi\ <x), x>0 

is regularly varying at infinity with index 2 — a. The latter implies that we can 
choose 



:=infk>0:^<i|, n > 1. 
In this case the sequence {c„} is regularly varying with index 1/a and, furthermore. 



V{Cn) 1 

— 2 ,n->oo. (1) 

In this note we consider the case when {Sn} belongs to the domain of attraction 
of a stable law with index a S (1,2] and EXi — 0. It is known that under these 
assumptions we can choose 6„ = 0. Hence, we have the convergence 

— — > ^ weakly. 

Let {ft,t > 0} denote a stable Levy process, where £_i is equal in law to ^. We 
also need to define the supremum of the process {^f — t}t>o via 

Ar = sup{6-n, 

t>0 

which is a proper random variable as — t drifts to — cxd as t — > oo. 
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For any a e (1,2] one can choose a positive integer- valued function n(a) such 
that 

an{a) ^ c„(a) as a —> 0. (2) 

It follows from the regular variation of {c„} that n(a) is regularly varying at zero 
with index — a/(a — 1). This, in its turn, implies that c„(a) is regularly varying 
with index — 1/(q; — 1). 

Theorem. Suppose that belongs to the domain of attraction of a stable law 

with index a £ (1,2]. Then, as a — + 0, 

> M* in law. (3) 

The theorem implies that A/^"-* grows as a regularly varying at zero function 
with index — 1 / (a — 1 ) . The limit distribution (that of Af * ) is only known explicitly 
in two particular cases. If {^t} has no positive jumps, then one has an exponential 
distribution. If {^t} has no negative jumps and a < 2, then M* has a Mittag-LefHer 
distribution (see, e.g., U). In the other cases the explicit form of the distribution 
is unknown, however, one can easily find its tail asymptotics P(Af* > x) ~ Cx^~°' 
as X ^ oo. 

We will provide two different proofs of the theorem, with the use of both methods 
mentioned above. However, we would like to start by giving a brief description and 
comparison of the two methods. 

The first, analytical, method is based on the analysis of the Laplace transform of 
the normalised maximum of a random walk. It was proposed by Kingman [SI [51 [7]. 
The idea is to use a corollary of the Wiener- Hopf factorisation: 

Ee""^ = exp I - fj Ie (^1 - e""^ ; si""^ > 0^ | , M > 0. 

In |7] heuristic arguments are given stating that the main contribution to the infinite 
series in the exponent on the RHS is due to the values of k of order n{a). This, 
however, was not proved formally. Instead, the author represented the exponent in 
the form of an integral along the imaginary axis and gave a proof of the statement 
by solving a Wiener-Hopf boundary- value problem. The same method was used 
later by Boxma and Cohen |5] and Cohen [3j in the case of an infinite variance. 

Our proof justifies the heuristic arguments of Kingman. The main difficulty 
consists in showing that the contribution to the infinite series on the RHS of the 
latter equality from values of ^ n(a) is negligible. This is shown in our proof to 
follow from 



lim > 

T^oc ^ — ' 

k>Tn[a) 



\v[st^>^)^^ (4) 



uniformly in a > 0. Thus, the derivation of Q will be the crucial step in our proof. 

We now turn to the second method used in the literature, namely the method 
based on functional limit theorems. Consider the maximum of {S'i"''} on a finite- 
time interval 

a4"^= sup S^^\ 

k<Tn{a) 
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It easily follows from the functional limit theorems for asymptotically stable random 
walks that 



a— >o 

for any x > 0, where 



lim P I >x] ^ P{M^ > x) 

Cn{a) I 



= sup{6 - t}. 

t<T 



The latter convergence implies that 

lim lim P >x\= P(M* > x). 

T^OOQ^O yCn{a) J 

However, in order to prove the theorem, one needs to show that 
lim lim P >x]^ P{M* > x). 



Therefore, it remains to justify the interchange of limits. It is easy to see that a 
sufficient condition could be written as 



T- 



lim P sup S*^"^ > = (5) 



k>n{a)T 



uniformly in a > 0. This was shown by Prokhorov [8J in the case of a finite variance 
with the application of the classical Kolmogorov inequality. Later, Asmussen [TJ 
page 289] proved the same result using the fact that the sequence {Sn/n} is a 
backward martingale. This fact was also utilised by Furrer [5| and Resnick and 
Samorodnitsky [lOj in the case of an infinite variance. 

We are now going to state and to prove a generalisation of the Kolmogorov 
inequality which allows one to overcome the technical difficulties in both approaches 
described above, namely, to prove ([4]) and ([5]). A formal proof of the theorem using 
both approaches is provided after the proof of the following lemma, which is an 
easy consequence of Pruitt's bound, see [9]. 

Lemma. There exists C > such that the inequality 

Pfmax^fe>x) <C^^^ (6) 

\k<n J X^ 

holds for all X > 0. 

Proof. According to inequality (1.2) in [S], 

P^maxS-fc > < Cn(p{\Xi\ > + x-i|E(Xi; \Xi\ < x)\+x-^Vixfj (7) 

(here and in what follows C denotes a generic positive and finite constant). 
It is easy to see that 

P{\x,\ > x) = ^P(|Xi| e {Vx,2=+^x]) < ^ -^^-P- 

3=0 J=0 

< ]^4C(7)y 2-("-^)^ 
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where in the last step we used the inequahty 

^<c^(7)(-j , y>^. (8) 

which follows from the Karamata representation, see [131 Theorem 1.2] (recall that 
V{x) is regularly varying with index 2 — a). Choosing 7 < a, we get 

V{\X,\>x)<C^. (9) 
In a way similar to that used in obtaining ([5]), we can get the bound 

|E(Xi; |Xi| < a;)| = |E(Xi; \Xi\ > x)\ < C-^. (10) 

X 

Combining ([7]), ^ and pH)) . we get inequality The proof is thus complete. □ 
Proof of the theorem via Wiener-Hopf. The Wiener- Hopf factorisation implies that 

Ee--'"'=exp|f:lE(e--r-l;5r)>0)| 

for any A > 0, see, e.g. jTU Proposition 19.2]. For the purposes of our proof, we 
set A = A'/c„(a) where ^ > 0. In these terms the latter equality takes the form 

Ee-€7 . exp I - f Ie (^1 - ; > | . (11) 

We aim at showing that a pointwise, in /i, limit of this Laplace transform is equal 
to the Laplace transform of M*. 

Fix £ £ (0, 1), T > 1 and divide the sum in the exponent in pi|l into three parts: 

CO en(a) Tn{a) oo 

E=E + E + E =:Si + s2 + 5^3. 

fc=l k=l k=en{a) k=Tn{a) 

We will now analyse these three summands separately. 

It follows from the inequalities < 1 — e~* < t for any positive t that 



s 



(o) 



< E I 1 - e ; si'''' > ) < -^E (^^^^ 5^°^ > 



Note that E (s'^''^ ^"^"^ > o) = E (5*^ - ka; Sk > ka) < E{Sk] Sk > 0). Since S'„ is 
asymptotically stable with a > 1, 

lim c-iE(5„; Sn>0)^ E(ei; 6 > 0). 

n — >oo 

This implies that E{Sk; Sk > 0) < Cck for all fc > 1. As a result we have the bound 
< E f 1 - e"""^ ; Si""^ >o] < C^i-^ 



Hence, 



eji(a) 

0<Si<^^^. (12) 



6 



SHNEER AND WACHTEL 



Since the sequence {ck} is regularly varying with index l/a G (0, 1), 

n 

ECk 1 

— ^ —Cn as n 00. 
k a 



Consequently, 

en{a) 

E f =^^c,„(,) <C£i/"c„(,). (13) 

k=l 

Estimates ((12]) and ((13]) imply that 

< Si < Ce^/"^. (14) 
In order to bound E3 we note that 

< E ^1 - e"''^;5^"^ > j < P(5^"' > 0) = P{Sk > ka). 

Using the lemma, we obtain 

V{ka) r V{x] 



0<E,< ^ lp(5.>H<C E '^<cir 



fe=T„(a) - fc=rn(a) « ^Tan(a) 



Recalling that V{x) is regularly varying with index 2 — a, we continue with 

S3 < < CTi--^^^^ < CTi-". (15) 

Ta^n(a) a n(a) 



In the last step we used the relations 

V{an{a)) ^ V{cn(a)) 
a'^n{a) {Cn(a)Y 



n{a) - 1, a ^ 0, (16) 



which follow from ((T]). 

It now remains to analyse S2- Using the assumption that Sk/ck converges in 
law to ^1, we get 



^n(a) ^n{a) ^n(a) 

v^/'^ii-v (17) 



Sk Ck ka 



in distribution as a — > and k/n{a) — > u e (0, cxd). In the last step we used ((2]) 
and the regular variation of {ck}. It follows from the scaling property of the stable 
process {^t} that and ^„ are equal in law. From this relation and ((T7)) we 

conclude that 

E I l-e"''^;5'[.''^ >0j ^ E (l - e-^(«"-''); - w > 
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as a ^ and k/n{a) — > w e (0, oo). Using now the dominated convergence we see 
that, as a — > 0, 



Tn{a) / s(-) \ 

k=en{a) \ / ^ ' 



j -E(l-e-''(«"-'');e«-w>0)dw. (18) 



It is clear that the process ^ — t drifts to —oo. Then, using [121 Theorem 48.1], we 
obtain 



hm 



j iE(l-e-'^(«"-'');^^-z;>o)dv 

= y -E(^l-e-^(«"-^);e^-w>Ojrfw<cx). (19) 
Hence, combining (fTT|) . IM]) . pS]) and (fTB]) and letting e ^ 0, T ^ oo, we get 
exp|-j|| (l -e-^(«"-'');^^ -w > dwj as a -> 0. 



Ee "^"f") 



The latter expression is known to be the Laplace transform of M* , see again [121 
Theorem 48.1]. This completes the proof. □ 

Proof of the theorem via functional limit theorems. Our proof in this case is closely 
related to the description given in the discussion after the statement of the theorem. 
However, for the sake of mathematical rigour, we provide here a complete proof. 

According to the functional limit theorem for asymptotically stable random 
walks, 

i^^.t^[0-T]]^{^ute[Q-T]] 
L c„ J 

in distribution. Therefore, as a | 0, 
f S[n{a)t\ - [an{a)t] 

^ Cn{a) 

This convergence implies that 

limPf max s[°''^ > xc„(a)] = P(sup(£t —t)>x], x >0. 

alQ \k<n(a)T ^ ' ) \t<T ' 

Since sup(£f — t) converges to M*, The theorem will be proved, if we show that 

mil J. 1 iiidA. ^_ 

T^oo \k>n{a)T 

uniformly in a > 0. 
Note that 



;ie [0;T]}^Ut-t;iG [0;T]}. 



lim P max S^^ > = (20) 

T^oo \k>n{a)T ) 



OO 

( max S^^'^ > 0| I j ( max (5fc - ka) > o] 

lk>n(a)T J ^ lke[2o n(a)T.2i + ^n(a)T} i 

i=o 

oo 

C N max Sk > 2^ an(a)i > 

^ lk<2o + ^n(a)T J 
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From this relation and the lemma we obtain 
P 



( max Si"^ >0) < Vpf max Sk > 2^ an(a)i 

\k>n{a)T " ) ^ \k<2i + ^n{a)T 

3=0 

2^+^n{a)TV{2^an{a)T) 



OO 



{Van{a)TY 

_2C ^ y(2%n(a)r) 

~ ~ ^ 2ian(a)T 
j=o ^ ' 

With the use of ([5]) with some 7 < a — 1 the latter expression can be estimated by 

^ y{an{a)T) ^ 
a'^n{a)T 

The regular variation of V{x) and yield the bound 

Viania)T) ^ 
a'^n{a)T ~ ' 

which implies (j20p . completing our proof. □ 

At the end we would like to make a few remarks. First of all we note that our 
assumption on the family of random walks can be weakened. We assumed that 
5"^°^ = Sk — ka for the transparency of all proofs. However, all our arguments 
remain valid if we assume, for instance, that 

1=1 



where {Y^"^^} is a sequence of i.i.d. random variables such that Ey/"'' = and 
E|y/"^|T < 00 uniformly in a for some 7 > a. Indeed, one can easily verify that, 
uniformly in a, 

S"!"^ +na 

> ^ weakly 



and, furthermore, 

E 



(^(5j°^+a)';|5j"^+a| < <CV{x) 



with the latter bound allowing us to apply the lemma to the random walk {54"' + 
na}. 

Moreover, in the case of a finite variance, for our arguments to remain valid, it 
is sufficient that a Lindeberg-type condition holds, i.e. 

where {xf '} is a sequence of i.i.d. random variables such that 'EX["'^ = —a, 
lim VarX^"^ = ct^ e (0, 00) and 



lim^ E ( (x^°') ; ixi''^ I > £ j = for all e > 0. (21) 
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The latter condition seems to be optimal. On the one hand, it is necessary, ac- 
cording to the Lindeberg theorem, for the normal approximation of aSj^^a- On the 

other hand, Sakhanenko [H] gave an example of a family S*^"-* such that pT|) fails 
and Mf"^) = for all a. 
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